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Research  Activities 

The  objective  of  the  research  under  this  ONR  award  is  to  develop  multisensor  management  and  data  fusion 
algorithms  for  tracking  applications.  Given  a  suite  of  disparate  sensors  having  varying  sensing  abilities,  we 
are  developing  sensor  management  techniques  for  determining  which  sensors  should  be  allocated  for  which 
targets  at  various  time  intervals  in  order  to  achieve  the  desired  precisions  in  tracking  the  targets.  We 
are  also  developing  a  decorrelated  sequence  technique  to  decorrelate  decentralized  target  state  estimates 
so  that  they  can  then  be  combined  using  a  number  of  centralized  sensor  fusion  approaches.  As  we 
are  developing  these  multisensor  management  and  data  fusion  algorithms,  we  are  investigating  various 
methods  of  implementing  as  well  as  efiSciently  evaluating  the  algorithms  developed.  Finally,  as  we  proceed 
with  our  research,  we  always  work  to  focus  our  efforts  so  that  our  results  will  be  useful  for  Naval  tracking 
and  surveillance  systems. 

Since  the  beginning  of  this  project  in  October  2001,  we  have  achieved  results  in  several  different  areas: 

•  Multisensor  target  tracking  is  often  performed  using  a  single  processor  to  monitor  several  sensors 
(centralized  fusion),  but  this  method  is  demanding  of  both  computational  power  and  communication 
bandwidth.  Distributed  sensor  fusion  is  a  method  of  addressing  these  limitations.  However,  the 
distributed  sensor  fusion  problem  is  more  complex  due  to  the  correlation  of  separate  track  estimates. 
We  are  working  to  develop  a  technique  for  decorrelating  target  state  estimates  at  decentralized 
locations  so  that  they  can  be  more  easily  combined  to  form  global  state  estimates  for  targets  in 
the  surveillance  region  [A,D,L,M].  We  are  currently  evaluating  computational  and  communication 
requirements  and  Monte  Carlo  simulation  studies  are  being  run  so  that  we  can  carefully  compare 
the  tradeoffs  with  centralized  sensor  fusion  as  well  as  other  distributed  fusion  algorithms. 

•  We  have  begun  a  study  comparing  a  number  of  recently  proposed  multisensor  multitarget  tracking 
algorithms  [E].  While  various  tracking  techniques  have  been  proposed  over  the  last  decade  and  have 
been  shown  to  perform  Veil”  in  difficult  tracking  environments,  very  few  detailed  comparisons  have 
been  made  across  these  algorithms.  Our  initial  results  show  some  delineation  on  which  algorithms 
perform  better  in  certain  scenarios. 

•  Because  Monte  Carlo  simulation  evaluations  of  multisensor  multitarget  tracking  algorithms  are  time 
consuming  and  expensive,  we  are  developing  efficient  techniques  for  comparing  such  algorithms. 
Given  a  fixed  computing  budget,  we  have  derived  an  Optimized  Computing  Budget  Allocation 
(OCBA)  algorithm  that  efficiently  compares  various  sensor  fusion  algorithms  in  terms  of  root- 
mean-square  (RMS)  position  tracking  error  [G].  Previous  computing  budget  allocation  methods 
were  developed  for  large  manufacturing  optimization  problems  where  the  performance  metric  to  be 
compared  across  designs  is  the  mean.  Because  RMS  position  tracking  error  is  a  common  performance 
measure  used  in  evaluating  sensor  fusion  algorithms,  we  investigated  the  statistics  of  the  RMS 
position  error  performance  metric  and  extended  previous  computing  budget  allocation  ideas  to  be 
applicable  for  efficiently  comparing  multisensor  fusion  algorithms. 

In  studying  the  statistics  of  the  position  error,  we  have  also  developed  a  better  model  of  the 
distribution  of  position  error  in  target  tracking  algorithms.  While  it  has  usually  been  assumed  that 
the  position  error  has  a  Gaussian  distribution,  we  have  shown  [C,F,H]  that  this  is  only  justified  when 
tracking  is  “good.”  When  difficult  tracking  scenarios  are  considered  (which  include  loss  of  track  or 
bias  caused  by  target  interaction  in  multi-target  tracking),  we  have  shown  that  the  distribution  of 
the  position  error  is  more  complex.  However,  this  distribution  can  be  well  modeled  using  a  mixture 
of  Gaussians  [C,F,H],  and  we  have  applied  a  greedy  Expectation  Maximization  (EM)  algorithm 
for  estimating  the  Gaussian  mixture  parameters.  We  have  also  developed  variance  estimation  and 
ranking  tools  for  such  Gaussian  mixture  distributions. 
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We  have  applied  the  extended  OCB  A  technique  for  evaluating  the  optimal  order  of  sensor  processing 
when  measurements  are  received  from  different  quality  sensors.  We  have  validated  previous  results 
(obtained  via  time  consuming  Monte  Carlo  simulations)  with  high  confidence  levels  while  reducing 
the  computational  effort  by  an  order  of  magnitude.  We  have  further  evaluated  more  general  scenar¬ 
ios  and  have  shown  with  high  confidence  that  when  measurements  are  available  from  many  sensors 
of  varying  qualities,  it  is  best  to  process  the  data  from  the  sensors  in  a  reverse  quality  ordering. 
That  is,  in  order  to  achieve  the  lowest  overall  RMS  tracking  error,  it  is  optimal  to  process  the  worst 
sensor  first,  then  the  next  better  sensor,  and  so  on  until  the  best  sensor  is  processed. 

We  have  also  applied  the  augmented  OCBA  approach  for  ranking  and  comparing  different  types  of 
particle  filters  [F].  We  have  shown  that  the  position  error  distribution  in  difficult  non-linear  tracking 
scenarios  can  be  well  modeled  by  Gaussian  mixtures  and  that  when  the  number  of  particles  used 
in  various  types  of  particle  filters  is  small,  the  OCBA  quickly  determines  with  high  confidence 
levels  that  one  type  of  particle  filter  (Auxiliary  Sampling  Importance  Resampling  particle  filter)  is 
superior  to  several  other  particle  filters  that  have  recently  become  popular  in  the  literature. 

•  Using  multiple  sensors  in  surveillance  systems  allows  the  strengths  of  one  sensor  type  to  compensate 
for  the  weaknesses  of  another  and  further  provides  redundance,  therefore  increasing  system  robust¬ 
ness.  However,  because  of  limited  sensor  resources  and  limited  processing  capabilities,  only  a  subset 
of  the  sensors  can  be  allocated  to  various  targets  at  each  time  interval.  We  are  developing  several 
schemes  for  controlling  sensor  information.  In  order  to  keep  the  mathematics  more  tractable,  we 
have  initially  [B]  assumed  a  centralized  processing  architecture,  where  the  measurements  from  all 
sensors  are  sent  to  a  global  processor  where  the  measurements  are  fused  and  used  for  estimating 
the  states  (position,  velocity,  etc.)  of  the  objects  in  the  surveillance  region.  We  have  developed 
several  algorithms  that  maintain  a  target’s  state  estimate  covariance  near  a  desired  level  without 
over-taxing  the  computational  resources  of  a  tracking  system.  Further  insights  have  been  provided 
to  guide  the  selection  of  effective  covariance  goals.  We  have  also  modeled  and  evaluated  the  effects 
that  (inevitable)  sensor  request  delays  can  have  on  performance  [B]. 

While  these  initial  covariance  control  algorithms  were  developed  for  scenarios  when  only  pure  filter¬ 
ing  is  required  for  tracking,  we  have  also  extended  the  algorithms  to  address  the  presence  of  clutter 
measurements  and  the  need  for  data  association  in  such  cases  [I].  A  method  of  reducing  the  effects  of 
data  association  on  covariance  control  algorithms  has  been  outlined  using  the  previously  developed 
scalar  “loss  of  information”  factor  to  model  the  impact  of  data  association  on  the  uncertainty  of 
the  target  state  estimates  .  Monte  Carlo  simulations  show  that  without  this  factor,  the  covariance 
control  system  is  unable  to  maintain  the  desired  covariance,  resulting  in  a  much  larger  actual  co- 
variance  level  and  ultimately  a  much  higher  rate  of  track  loss.  Use  of  the  loss  of  information  factor 
generally  restores  system  performance. 

We  have  further  extended  the  sensor  management  approach  to  reduce  bias  in  estimates  that  results 
when  targets  are  closely  spaced  and  interact  [J].  By  developing  an  efficient  technique  for  assessing 
whether  targets  are  interacting  £ind  determining  the  “worst”  directions  of  interaction,  sensors  are 
allocated  to  reduce  these  interactions  and  hence  mitigate  bias  in  the  track  estimates  for  such  targets. 

We  are  continuing  to  explore  an  approach  for  developing  sensor  manager  algorithms  for  decentralized 
multisensor  systems,  where  we  are  deriving  two  computationally  efficient  techniques  that  have  low 
communication  bandwidth  requirements  and  allow  sufficient  nodal  autonomy. 

Outreach  Activities  and  Honors  and  Awards 

I  have  recently  received  the  following  awards  and  have  participated  in  the  following  activities  and  posi¬ 
tions  in  various  profession^  societies  to  promote  reseaurch  in  estimation  and  sensor  fusion: 

•  2001-2002  University  of  Colorado’s  Council  on  Research  and  Creative  Work  Faculty  Fellowship 
Award. 
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•  Special  service  recognition  award  from  the  American  Automatic  Control  Council  (AACC)  in  May 

2002. 

•  Vice  Chair  for  Invited  Sessions  for  the  2003  American  Control  Conference. 

•  Appointed  member  of  the  IEEE  Control  Systems  Society  Board  of  Governors  for  2003. 

•  Program  Chair  for  the  2004  American  Control  Conference. 

•  Member  of  the  International  Federation  on  Automatic  Control  (IFAC)  Committee  on  the  Past, 
Present,  and  Future  of  Control  Education,  2003-  . 

•  Associate  Editor  for  the  International  Journal  of  Control,  Automation,  and  Systems,  2003-  . 

•  Invited  presentations: 

—  Efficient  and  Effective  Ways  of  Processing  Sensor  Information  for  Tracking  Targets  in  Clut¬ 
tered  Environments,  University  of  Connecticut,  Nov.  2001. 

—  Sensor  Fusion  Techniques  for  Tracking  Multiple  Targets  in  Cluttered  Environments,  Alphat- 
ech,  Inc.,  Feb.  2002. 

—  Multisensor  Fusion  Algorithms  for  Target  Tracking,  Harvard  University,  Apr.  2002. 

—  Variance  Estimation  and  Ranking  with  Applications  to  Target  Tracking  Algorithms,  George 
Mason  University,  Apr.  2003. 

—  Distributed  Multisensor  Tracking  of  Interacting  Targets  in  Cluttered  Environments,  Orincon 
Corporation,  Apr.  2003. 

•  Chaired  the  following  sessions  at  the  2002  American  Control  Conference: 

—  “Estimation”  (chair) 

—  “Aerospace  and  Flexible  Structures”  (chair) 

—  ‘Time- Varying  Estimation”  (chair) 

•  Chaired  the  following  sessions  at  the  2002  IFAC  Conference  on  Mechatronic  Systems: 

—  “Control  of  Flexible  Structures  F’  (chair) 

—  “Control  of  Flexible  Structures  11”  (chair) 

—  “Haptic  Interfaces”  (chair) 

•  Chaired  the  following  sessions  at  the  2002  IEEE  Conference  on  Decision  and  Control: 

—  “Stochastic  Systems”  (chair) 

“  “Systems  with  Nonlinear  Dynamics”  (chair) 

•  Chaired  the  following  session  at  the  2003  American  Control  Conference: 

“  “Concurrent  Feedback  Control  Design  and  Command  Shaping”  (co-chair) 

•  Invited  to  organize  a  Tutorial  Session  on  Multisensor  Management  and  Fusion  Algorithms  for  Tar¬ 
get  Tracking  for  the  2004  American  Control  Conference  [K]. 

Summary 

Our  research  results  will  provide  insight  as  to  the  relative  performance  of  various  multisensor  manage¬ 
ment  and  fusion  methods,  and  the  results  will  also  provide  a  basis  for  assessing  the  tradeoffs  between 
performance  and  computational  and  communication  requirements  when  planning  new  sensor  network 
architectures  or  communication  link  protocols.  We  have  disseminated  our  research  findings  through  our 
publication  and  outreach  activities  and  our  results  have  been  well  received  by  the  community. 
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